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Independent Random Variables 


3.1.4 Independent Random Variables 

In real life, we usually need to deal with more than one random variable. For example, if you study physical characteristics of 
people in a certain area, you might pick a person at random and then look at his/her weight, height, etc. The weight of the randomly 
chosen person is one random variable, while his/her height is another one. Not only do we need to study each random variable 
separately, but also we need to consider if there is dependence (i.e., correlation) between them. Is it true that a taller person is more 
likely to be heavier or not? The issues of dependence between several random variables will be studied in detail later on, but here 
we would like to talk about a special scenario where two random variables are independent. 

The concept of independent random variables is very similar to independent events. Remember, two events A and B are 
independent if we have P{A, B ) = P(A)P(B) (remember comma means and, i.e., 

P(A, B) = P(A and B ) = P(A n B)). Similarly, we have the following definition for independent discrete random 
variables. 


Definition 3.2 

Consider two discrete random variables X and Y. We say that X and Y are independent if 

p(x = x,Y = yj = P(X = x)P(Y = y), for all x,y. 

In general, if two random variables are independent, then you can write 


P\ X E A,Y € B 


P(X e A)P(Y € B), 


for all sets A and B. 


Intuitively, two random variables X and Y are independent if knowing the value of one of them does not change the probabilities 
for the other one. In other words, if X and Y are independent, we can write 

P(Y = y\X = x) = P{Y = y), for all x,y. 

Similar to independent events, it is sometimes easy to argue that two random variables are independent simply because they do not 
have any physical interactions with each other. Here is a simple example: I toss a coin 2N times. Let X be the number of heads 
that I observe in the first N coin tosses and let Y be the number of heads that I observe in the second N coin tosses. Since X and 
Y are the result of independent coin tosses, the two random variables X and Y are independent. On the other hand, in other 
scenarios, it might be more complicated to show whether two random variables are independent. 


Example 3.6 


I toss a coin twice and define X to be the number of heads I observe. Then, 
number of heads that I observe this time. Find P I ( X < 2) and (Y > 


I toss the coin two more times and define Y to be the 



Solution 

o Since X and Y are the result of different independent coin tosses, the two random variables X and Y are 
independent. Also, note that both random variables have the distribution we found in Example 3.3 . We can write 


p({X < 2) and (Y > 1) J = P{X < 2 )P(Y > 1) 


(because X and Y are independent) 


= {Px(0) + Px(1))Py(2) 

= (- + -)- 
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We can extend the definition of independence to n random variables. 


Definition 3.3 

Consider n discrete random variables Xi, X2, X3,.. ., X n . We say that Xi, X2, X3, ... , X n are independent if 

P X2 %2 j • • • ) X n 

= P{X 1 = Xi )P(X 2 = x 2 )...P{X n = x n ), for all xi,x 2 , ■ ■ ■ ,x n . 
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